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1. INTRODUCTION 

Convection- allowing numerical weather simula- 
tions have often been shown to produce convective 
storms that have significant sensitivity to choices of 
model physical parameterizations. Among the most 
important of these sensitivities are those related to 
cloud microphysics, but planetary boundary layer 
parameterizations also have a significant impact on the 
evolution of the convection. Aspects of the simulated 
convection that display sensitivity to these physics 
schemes include updraft size and intensity, simulated 
radar reflectivity, timing and placement of storm initi- 
ation and decay, total storm rainfall, and other storm 
features derived from storm structure and hydrometeor 
fields, such as predicted lightning flash rates. 

In addition to the basic parameters listed above, 
the simulated storms may also exhibit sensitivity to im- 
posed initial conditions, such as the fields of soil temper- 
ature and moisture, vegetation cover and health, and 
sea and lake water surface temperatures. Some of these 
sensitivities may rival those of the basic physics sensi- 
tivities mentioned earlier. These sensitivities have the 
potential to disrupt the accuracy of short-term forecast 
simulations of convective storms, and thereby pose sig- 
nificant difficulties for weather forecasters. 

To make a systematic study of the quantitative 
impacts of each of these sensitivities, a matrix of 
simulations has been performed using all combinations 
of eight separate microphysics schemes, three boundary 
layer schemes, and two sets of initial conditions. The 
first version of initial conditions consists of the default 
data from large-scale operational model fields, while 
the second features specialized higher- resolution soil 
conditions, vegetation conditions and water surface 
temperatures derived from datasets created at NASA’s 
Short-term Prediction and Operational Research Tran- 
sition (SPoRT) Center at the National Space Science 
and Technology Center (NSSTC) in Huntsville, AL. 
Simulations as outlined above, each 48 in number, 
were conducted for five midsummer weakly sheared 
coastal convective events each at two sites, Mobile, 
AL (MOB) and Houston, TX (HGX). Of special 
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interest to operational forecasters at MOB and HGX 
were accuracy of timing and placement of convective 
storm initiation, reflectivity magnitudes and coverage, 
rainfall and inferred lightning threat. 

2. DATA AND METHODOLOGY 

The NWP model used in this study is the Weather 
Research and Forecasting (WRF) model, version 3.4.1, 
invoking the Advanced Research WRF dynamical core. 
The WRF model was executed using two nested grids 
covering areas centered on either MOB or HGX. The 
outer grid used a 9-km mesh with convection parame- 
terized by the Kain-Fritsch cumulus scheme, while the 
inner 3-km grid used explicit convection. Besides the 
Kain-Fritsch scheme on the outer grid, other physi- 
cal parameterization schemes held fixed in this study 
include the Dudhia shortwave radiation, RRTM long- 
wave radiation, and Noah land surface model, all of 
which are documented in Skamarock et al. (2008). 
Each WRF run is configured with 40 standard sigma- 
pressure vertical layers, on a stretched grid with a 50- 
mb domain top. For each of five case dates in the 
summer of 2012 at both MOB and HGX, a matrix of 
24 WRF simulations (8 distinct microphysics choices 
paired with 3 distinct boundary layer physics choices) 
was executed twice, once with default WRF conditions 
(’’control” runs), and again with more detailed SPoRT 
data (’’SPoRT” runs). In the control runs, the model 
used static fields and initial and boundary condition 
inputs supplied by the NCEP Global Forecast System 
(GFS) model 3-hourly forecasts, while the SPoRT runs 
utilized SPoRT-generated surface data obtained from 
the NASA Land Information System (LIS) offline inte- 
gration of the Noah land surface model on a 3-km grid 
mesh (Case and White 2014), along with real-time 1- 
km MODIS green vegetation fraction (GVF ; Case et al. 
2014) projected onto a 4-krri grid, and 2-km sea surface 
temperature composites (Case et al. 2012). The latter 
datasets are maintained at NASA’s SPoRT Center and 
are produced in real-time for use in local NWP appli- 
cations at many NOAA/NWS forecast offices. Each 
simulation was launched at 0600 UTC, during the diur- 
nal minimum of convective activity, and was run for 24 
h using 0-24 hour forecasts from the 0600 UTC cycle 
of the GFS model for initial and boundary conditions. 



Maps of the outer and inner domains for MOB are given 
in Fig. f. The domains for HGX are constructed in an 
analogous manner. 

Weakly sheared summertime convection cases 
were selected for study, because they are especially 
challenging for forecasters. As both MOB and HGX 
are situated near the Gulf coast, sea breezes often 
serve as the trigger for deep convection there, and the 
location, timing and intensity of the weakly sheared 
convection can be difficult to forecast. 

Hourly plots of a multitude of basic and derived 
model output fields were examined to assess the perfor- 
mance of each WRF configuration in terms of accuracy 
of the simulated timing, location and character of 
the forecast convection. Parameters studied included 
peak mid-level updraft speeds, composite reflectivi- 
ties, location and timing of storm development, total 
storm rainfall, and peak lightning flash rate densities 
inferred from the WRF Lightning Forecast Algorithm 
(LFA; McCaul et al. 2009, McCaul et al. 2013). 
Reflectivities within the simulations were computed 
using the default WRF method, without customized 
embellishments for any of the microphysics schemes; 
although such embellishments were recommended for 
some schemes, the custom WRF-supplied software 
tended to produce unreliable results for reflectivity, 
and was thus abandoned in favor of the default soft- 
ware. The eight microphysics and three boundary 
layer schemes used in the simulation matrices are 
listed in Table 1. Microphysics schemes ranged from 
the legacy WRF Single Moment 6-species (WSM-6) 
scheme up through the more recent and sophisticated 
NSSL double moment scheme. The quasi-double 
moment Thompson scheme is also included, so that 
insights into its relative performance in operational 
forecasts by such as the High-Resolution Rapid Refresh 
(HRRR) WRF model can be examined. Microphysics 
schemes include WSM-6, Lin (LIN), Goddard (GOD), 
WRF Double Moment-6 Species (WDM-6), Thompson 
(THOM), Morrison (MORR), Milbrandt-Yau (MIL), 
and NSSL. Local mixing planetary boundary layer 
(PBL) schemes used included Mellor-Yamada-Janjic 
(MYJ), Quasi-Normal Scale Elimination (QNSE) and 
the Mellor-Yamada-Nakaniishi-Niino (MYNN). 

Model output was compared both subjectively 
and objectively with radar-derived reflectivity data, 
and with rainfall data inferred from a combination of 
radar and rain gage data. For reflectivity, objective 
comparisons were made of the peak reflectivities seen 
in any of the simulations versus the peak observed 
values. For rainfall, patterns and amounts were scored 
against rainfall observations using the NCAR Model 
Evaluation Tools (MET) verification package. In the 
latter case, statistics such as time-dependent Heidke 
Skill Scores (HSS) were computed so that the rainfall 
performance of the various simulations could be de- 
termined in comparison to observations. Frequency 
of occurrence of gridpoints experiencing rainfall accu- 
mulations greater than a series of threshold amounts 


was also tallied, so that areal coverage biases in the 
various simulations could be documented. Peak 24-h 
rainfall accumulations in the simulations were also 
compared to peak values seen in the observations. To 
evaluate computational efficiency of the various WRF 
configurations, model run times for all the simulations 
were also tabulated, since run-time performance can 
have implications for the practicality of running certain 
configurations at NOAA/NWS forecast offices with 
limited computational capabilities. 

For evaluating the possible lightning activity in 
the simulated storms, the LFA, a simple diagnostic 
method for making quantitative estimates of total 
lightning flash rate densities (FRDs) in simulated 
storms was also applied, so that relative variations 
in the inferred lightning could be examined across all 
physics combinations. The WRF LFA considers two 
main simulated variables, the upward graupel flux 
(GFX) in the mixed phase layer, which dictates the 
amplitude of the FRD estimates, and the total vertical 
ice integral (VII), which provides input regarding 
lightning threat footprint, as proxies for total lightning 
FRDs. For GFX, the layer with temperature of -15C is 
taken as the mixed phase layer. Both proxies have been 
found in global observational studies (Petersen et al. 
2005; Cecil et al. 2005; Deierling and Peterson 2008) 
to be strongly related to storm flash rates. In McCaul 
et al. (2009), the peak values of the two simulated 
proxies in convective events in the Tennessee Valley 
area were found to be linearly related to the peak 
total lightning flash origin densities observed by the 
North Alabama Lightning Mapping Array (Goodman 
et al. 2005; Krehbiel et al. 2000). In the LFA, the 
GFX proxy serves to define the amplitudes of FRD, 
but is blended with the more widely distributed VII 
field to enhance the areal coverage accuracy of the 
lightning threat, as described by lightning flash extent 
density. The LFA strives to produce fields of total 
lightning threat that exhibit peak FRDs that match 
those of the strongest storms in a convective event. 
The LFA-derived peak FRD values were examined 
herein primarily for the purpose of intercomparisons 
of performances of the various physics scheme choices 
against the original WSM-6 design of the LFA; direct 
comparisons with any possible LMA observations were 
not feasible. 

3. RESULTS AND DISCUSSION 

Inspection of the simulation output reveals con- 
siderable sensitivity and complexity in the convective 
response to the choices of microphysics and boundary 
layer parameterizations, and especially to input soil 
moisture, GVF, and sea surface temperature. As a gen- 
eral rule, it is found that for the dry summer of 2012, 
use of the detailed and generally drier soil moisture data 
from the SPoRT LIS-Noah datasets resulted in simula- 
tions that produced less convective rainfall than in the 
’’control” simulations. The dryness of the SPoRT sim- 
ulations is statistically advantageous for days having 



large amounts of convective rainfall, which the ’’con- 
trol” WRF runs tend to overdo. Such wet days were 
more common in 2012 among the MOB cases than the 
HGX cases. 

(a) 3 July 2012 case for MOB 

An example is shown in Fig. 2a(top) for 24-h total 
rainfall from 3 July 2012 from MOB, for the full set of 
24 ’’control” simulations. In Fig. 2b (bottom) is shown 
the full set of SPoRT-initialized simulations. Stage IV 
radar plus rain gage 24-h rainfall estimates (Lin and 
Mitchell 2005; Lin et al. 2005) for the 3 July case are 
shown in Fig. 2c. Time-evolving HSS values for the 
various QNSE schemes in the ’’control” and ’’SPoRT” 
simulations are provided in Fig. 3a-b (top and bottom, 
respectively). QNSE results are presented, as QNSE 
was found to be the best-performing PBL scheme in 
many instances. Note the general improvement in HSS 
values for the drier SPoRT runs, which is typical of 
what is seen in ”wet” events at MOB in 2012. Part 
of the reason for the higher HSS scores in the SPoRT 
runs lies in the fact that, in those runs, the convection 
initiates northeast of MOB, consistent with radar data, 
rather than northwest of MOB, as in most of the control 
runs. For the usually drier HGX cases, the SPoRT ini- 
tializations typically produced too little precipitation, 
often so much so that HSS scores were adversely af- 
fected for the SPoRT runs. An example of this is shown 
in Fig. 4a-b (top and bottom, respectively) for the 
QNSE runs. Note that the NSSL double-moment mi- 
crophysics scheme appears to yield higher HSS values 
in many cases. This NSSL microphysics advantage was 
also commonly seen for PBL schemes other than QNSE 
(not shown). 

Peak cumulative 24-h rainfall amounts from the 
’’control” simulations for MOB on 3 July 2012 revealed 
considerable variability, with the greatest peak rainfall 
being 167.91 mm from the LIN/MYJ simulation, 
and the smallest being 88.76 mm from GOD/MYJ. 
The MYJ schemes have the largest mean peak 24-h 
rainfall amounts, while MYNN has the smallest. Stage 
IV estimates of peak rainfall for this event reached 
only 70.13 mm, which indicates the extent of rainfall 
overprediction in the ’’control” simulations. For all 
PBL schemes, the Lin microphysics produces the 
largest rainfall. The relative sensitivity of peak rainfall 
amounts, as measured by the range of peak FRD 
values divided by their mean, is largest for the MYJ 
simulations. The ’’SPoRT” simulations also exhibited 
much variability, but with smaller mean values, closer 
in line with observations. The largest peak rainfall 
was 139.95 mm from LIN/MYJ, while the smallest 
was 52.28 (GOD/QNSE). The QNSE PBL scheme 
yielded the smallest mean of peak rainfall amounts, 
while MYJ yielded the largest. Relative variability 
of rainfall across microphysics choices was largest for 
the QNSE simulations, which also produced the least 
rainfall, on average. For the SPoRT runs, the smallest 
peak rainfall variability across microphysics schemes 


was seen with MYJ PBL physics, contrary to what 
was seen in the "control” runs. 

In terms of reflectivity in the ’’control” simula- 
tions, peak composite reflectivity reached 65.70 dBZ 
in THOM/MYJ, 60.44 in WDM-6/QNSE, and 62.97 in 
THOM/MYNN. The smallest peak reflectivities in each 
PBL series were 56-57 dBZ. Radar observations indicate 
that the true peak reflectivities were just above 65 dBZ, 
suggesting an advantage for Thompson/MYJ, and that 
the calculated reflectivities for almost all schemes are 
too small. This maximum in THOM/MYJ reflectivity 
performance is not matched, however, for LFA lightning 
FRDs, nor maximum 24-h precipitation. 

Peak simulated values for the SPoRT MYJ runs 
were 60.84 (NSSL), with 61.19 (THOM) for SPoRT 
QNSE runs, and 60.79 (THOM) for SPoRT MYNN 
runs. In addition to peak reflectivities, the means of 
the maximum values of reflectivity were also slightly 
reduced in the SPoRT runs. 

(b) LFA Analysis for 3 July 2012 MOB case 

Lightning flash rate forecasts from the WRF LFA 
also exhibited much sensitivity to physics choices within 
the 24-simulation ensembles. For the 3 July 2012 MOB 
’’control” cases, it is found, for example, that the great- 
est peak FRD, 24.05 flashes per sq. km/(5 min), is pro- 
duced by the LIN/QNSE scheme, while the least, 7.91, 
is produced by the GODD /MYNN scheme. The default 
microphysics used in the original LFA design, WSM-6, 
yielded a peak of 15.89 flashes per sq. km/(5 min) in 
QNSE, but 14.87 and 12.13 in MYJ and MYNN PBL 
runs, respectively. Meanwhile, the quasi-double mo- 
ment Thompson scheme as used in the HRRR model, 
yielded peak FRD values of 12.54, 11.38, and 9.50 for 
the MYJ, QNSE and MYNN PBL schemes. The HRRR 
actually employs the MYNN PBL scheme, so that it is 
suggested that HRRR LFA-derived FRD values in this 
case underestimate those from WSM-6 by a factor of 
0.60 = 9.50/15.89. Since the LFA is based on a simple 
linear relationship between GFX and FRD, recalibra- 
tion of HRRR FRD values to be consistent with those 
from WSM-6 should require a simple magnification by 
the factor 1.67. QNSE runs featured the largest mean 
values of peak FRD, while MYNN produced the least. 
The MYNN results also displayed, by a small margin, 
the largest amount of relative sensitivity across the 8 
microphysics runs. 

As expected, the corresponding peak FRD val- 
ues in the drier ’’SPoRT” runs were reduced relative 
to the ’’control” runs. The greatest peak FRD was 
9.46 for WSM-6/MYNN, while the least was 2.17 for 
NSSL/QNSE. The three WSM-6 peak FRD values were 
8.10, 5.14 and 9.46, for MYJ, QNSE and MYNN, re- 
spectively. For the Thompson scheme, peak FRD val- 
ues were 4.49, 5.86 and 4.48, respectively. The QNSE 
runs exhibited the smallest mean peak FRD values, but 
the largest relative variability. 

(c) Computational resource considerations 



Computational efficiency is also a practical con- 
sideration for use of the various physics and initializa- 
tion schemes. Inspection of run-time data from the 
simulations here (Fig. 5, results only from “control” 
simulations; “SPoRT” runs are similar) shows a clear 
tendency for simple schemes such as WSM-6/MYJ to 
run most quickly, while more elaborate schemes such 
as NSSL/QNSE can take nearly twice as much time to 
execute. The tradeoffs are not simple, as it was often 
the case that the more expensive scheme combinations 
turned in the best performances in terms of HSS. There 
are thus no obvious ’’best buy” recommendations, es- 
pecially when computational resources are limited, as 
is often the case at NWS forecast offices running local 
model simulations. 

4. SUMMARY AND FUTURE WORK 

This paper presents an analysis of a multi-physics 
combination matrix for weakly-sheared summertime 
convective events over the U.S. Deep South. A matrix 
of simulations was made for both a control configu- 
ration using only GFS model initial and boundary 
conditions, and an experimental configuration using 
higher-resolution input land surface fields, GVF, and 
SST from SPoRT-generated datasets. In general, the 
input drier soil moisture provided by the SPoRT-LIS 
yielded an overall reduction in precipitation coverage 
which improved verification scores in ”wet” cases, but 
degraded verification scores in ’’dry” case with more 
sparsely-distributed convection. While the matrix of 
PBL and microphysical schemes yielded variability in 
the space-time evolution of convection, it appears that 
the input SPoRT surface datasets often had an overall 
greater impact on the evolution of environmental 
conditions leading up to convective development. 

Future work will involve examining in greater de- 
tail the additional 4 MOB and 5 HGX case studies to 
formulate more robust conclusions about the overall 
impact of SPoRT surface datasets and its interaction 
with different combinations of PBL and microphysics 
schemes in the WRF model. These additional cases 
will also help to improve the understanding of WRF 
LFA behavior in the HRRR model, based on the com- 
parison between the WSM-6/MYJ in the original LFA 
calibration and the THOM/MYNN configuration in the 
current HRRR configuration. 
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Fig. 1. Map showing outer (blue) and inner (orange) simulation domain, for MOB area experiments. 






Fig. 2. Simulated total 24-h precipitation ending at 06 UTC 04 July 2012, for the MOB subdomain of Fig. 1. (a; 
top) from “control” simulations; (b; bottom) from “SPoRT” simulations; observations are provided in part (c), next 
page. Subdomain- wide maximum accumulations are printed on each plot panel of (a) and (b). Units are given in 
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Fig. 2c. Observed 24-h precipitation ending at 06 UTC 04 July 2012, for the MOB subdomain of Fig. 1. Data are 
from Stage 4 observations. Subdomain-wide maximum accumulations are printed on the plot panel, with units in 


mm. 
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Fig. 3. Time-evolving precipitation Heidke Skill Scores for each of the eight QNSE microphysics choices for the 03 
July 2012 storms at MOB. Legend describing the color codes for each scheme is provided at bottom, (a; top) Heidke 
scores for “control” simulations; (b; bottom) for “SPoRT” runs. 
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Fig. 4. As in Fig. 3, but for HGX subdomain. Note reduction of HSS values for the “SPoRT” runs during the period 
of active convection, in contrast to what was shown in Fig. 3. 
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Fig. 5. Plot of run time data for each of the “control” MOB simulations of 3 July 2012. Results for “SPoRT” runs 
and HGX runs were roughly similar. 


